Image detecting device and image detecting method using the same

ABSTRACT

An image detecting device includes a color image sensor configured to sense visible light and to output color image data based on the sensed visible light; a first infrared lighting source configured to provide first infrared rays to a subject; a second infrared lighting source configured to provide second infrared rays to the subject; a mono image sensor configured to sense a first infrared light or a second infrared light reflected from the subject and output infrared image data; and 
     an image signal processor configured to, measure an illuminance value based on the color image data, measure a distance value of the subject based on a portion of the infrared image data corresponding to the first infrared light, and obtain an identification image of the subject based on the illuminance value, the distance value, and a portion of the infrared image data corresponding to the second infrared light.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. application Ser. No.15/623,905, filed on Jun. 15, 2017, which claims priority under 35U.S.C. § 119 to Korean Patent Application No. 10-2016-0109256 filed Aug.26, 2016, Korean Patent Application No. 10-2016-0075316 filed Jun. 16,2016, and Korean Patent Application No. 10-2016-0081013 filed Jun. 28,2016, in the Korean Intellectual Property Office, the entire contents ofeach of which are hereby incorporated by reference.

BACKGROUND 1. Field

At least some example embodiments of the inventive concepts disclosedherein relate to an image sensor, and more particularly, to an imagedetecting device and an image detecting method using the same.

2. Related Art

Digital image capturing devices such as a digital camera and a digitalcamcorder obtain images by using an image sensor. Nowadays, a smartphoneor a personal computer (PC) may obtain an image by using an image sensorarranged on a front surface thereof. The image sensor may include, forexample, a charge coupled device (CCD) or a complementarymetal-oxide-semiconductor (CMOS) image sensor (CIS).

The image sensor may include a plurality of image sensor pixels. Theimage sensor pixels may be arranged in the form of an array. The imagesensor pixels output analog signals based on light incident thereon. Theanalog signals output from the image sensor pixels are converted intodigital signals, and the digital signals are stored as image data afterbeing digitized.

A recent image sensor is being used as an element of an image detectingdevice, which detects identification images through face recognition,iris recognize, etc. Also, there is an increasing need to implement twoor more functions with one image sensor while satisfying both an imagecapturing function and a function of exactly detecting an identificationimage.

SUMMARY

At least some example embodiments of the inventive concepts provide animage detecting device for detecting an identification image with adesirable degree of accuracy and an image detecting method using thesame.

An image detecting device includes a color image sensor configured tosense visible light and to output color image data based on the sensedvisible light; a first infrared lighting source configured to providefirst infrared rays to a subject; a second infrared lighting sourceconfigured to provide second infrared rays to the subject; a mono imagesensor configured to sense the first infrared light or the secondinfrared light reflected from the subject and output infrared image databased on the sensing of the first infrared light or the second infraredlight; and

an image signal processor configured to, measure an illuminance valuebased on the color image data, measure a distance value of the subjectbased on a portion of the infrared image data corresponding to the firstinfrared rays, and obtain an identification image of the subject basedon the illuminance value, the distance value, and a portion of theinfrared image data corresponding to the second infrared rays.

According to at least some example embodiments of the inventiveconcepts, an image detecting method includes providing first infraredrays to a subject such that the provision of the first infrared rays issynchronized with a sense time of a mono image sensor; generating, atthe mono image sensor, infrared image data by sensing the first infraredlight reflected from the subject during the synchronized time; measuringa distance between the mono image sensor and the subject based on theinfrared image data; and obtaining an identification image of thesubject when the measured distance is within a reference range.

According to at least some example embodiments of the inventiveconcepts, an image detecting device includes a color image sensor; amonochrome image sensor; and an image signal processor configured todetermine a distance value of a subject based on first infrared imagedata generated by the monochrome image sensor in response to firstinfrared light, determine an illuminance value of the subject based onthe distance value and color image data generated by the color imagesensor, obtain, based on the determined illuminance value, secondinfrared image data generated by the monochrome image sensor in responseto second infrared light, and obtain the identification image based onthe second infrared image data.

BRIEF DESCRIPTION OF THE FIGURES

As is traditional in the field of the inventive concepts, embodimentsare described, and illustrated in the drawings, in terms of functionalblocks, units and/or modules. Those skilled in the art will appreciatethat these blocks, units and/or modules are physically implemented byelectronic (or optical) circuits such as logic circuits, discretecomponents, microprocessors, hard-wired circuits, memory elements,wiring connections, and the like, which may be formed usingsemiconductor-based fabrication techniques or other manufacturingtechnologies. In the case of the blocks, units and/or modules beingimplemented by microprocessors or similar, they may be programmed usingsoftware (e.g., microcode) to perform various functions discussed hereinand may optionally be driven by firmware and/or software. Alternatively,each block, unit and/or module may be implemented by dedicated hardware,or as a combination of dedicated hardware to perform some functions anda processor (e.g., one or more programmed microprocessors and associatedcircuitry) to perform other functions. Also, each block, unit and/ormodule of the embodiments may be physically separated into two or moreinteracting and discrete blocks, units and/or modules without departingfrom the scope of the inventive concepts. Further, the blocks, unitsand/or modules of the embodiments may be physically combined into morecomplex blocks, units and/or modules without departing from the scope ofthe inventive concepts.

FIG. 1 is a block diagram illustrating an image detecting system,according to at least some example embodiments of the inventiveconcepts;

FIGS. 2 and 3 are block diagrams illustrating an image detecting device,according to at least some example embodiments of the inventiveconcepts;

FIG. 4 is a drawing for describing a method of measuring a distance byusing a mono image sensor, according to at least some exampleembodiments of the inventive concepts;

FIGS. 5 and 6 are flowcharts illustrating a method of detecting an imageby using an image detecting device, according to at least some exampleembodiments of the inventive concepts;

FIG. 7 is a block diagram illustrating an image detecting system,according to at least another example embodiment of the inventiveconcepts;

FIGS. 8 and 9 are sectional views of a color image sensor and a monoimage sensor;

FIG. 10 is a block diagram illustrating an image detecting device in aninfrared cut-off mode;

FIGS. 11 and 12 are drawings for describing a method of measuring adistance of a subject in an infrared cut-off mode;

FIG. 13 is a block diagram illustrating an image detecting device in aninfrared cut-off mode;

FIG. 14 is a flowchart illustrating a method of detecting an image byusing an image detecting device, according to at least another exampleembodiment of the inventive concepts; and

FIG. 15 is a block diagram illustrating an image signal processor,according to at least some example embodiments of the inventiveconcepts.

DETAILED DESCRIPTION

Below, at least some example embodiments of the inventive concepts willbe described more fully with reference to accompanying drawings.

FIG. 1 is a block diagram illustrating an image detecting system 1000,according to at least some example embodiments of the inventiveconcepts. According to at least some example embodiments of theinventive concepts, the image detecting system 1000 may be, or beincluded in, an electronic device. For example, the image detectingsystem 1000 may be, or be included in, at least one of a mobile phone, asmartphone, a tablet, a laptop, a smart pad, a smart television, a smartwatch, and a wearable device.

Referring to FIG. 1, the image detecting system 1000 includes an imagedetecting device 1100, an application processor 1200, a display 1300, astorage device 1400, a random access memory (RAM) 1500, and a modem1600.

The image detecting device 1100 includes a color image sensor 1110, amono image sensor 1120, a first infrared lighting unit 1130, a secondinfrared lighting unit 1140, and an image signal processor 1150. As usedherein, the term “mono image sensor” may refer to a monochrome imagesensor.

The color image sensor 1110 senses visible light, and the mono imagesensor 1120 senses infrared light. The color image sensor 1110 outputscolor image data CID, and the mono image sensor 1120 outputs infraredimage data MID. Detailed contents will be detailed later.

Each of the first infrared lighting unit 1130 and the second infraredlighting unit 1140 provide infrared illumination. The first infraredlighting unit 1130 provides first infrared rays, and the second infraredlighting unit 1140 provides second infrared rays. For example, as isdiscussed in greater detail below with reference to FIG. 3, the firstinfrared lighting unit 1130 may include a first infrared light source,and the second infrared lighting unit 1140 may include a second infraredlight source.

To measure a distance between a subject and the image detecting device1100, the mono image sensor 1120 senses first infrared light reflectedfrom the subject. The first infrared light is infrared light reflectedfrom the subject, based on the first infrared rays. The mono imagesensor 1120 and the first infrared lighting unit 1130 (e.g., an infraredlight source of the first infrared lighting unit 1130) may be arrangedadjacent to each other such that the first infrared light reaches themono image sensor 1120 after the first infrared rays being incident onthe subject and the first infrared light being reflected from thesubject even in the case where the subject and the image detectingdevice 1100 are close to each other.

The first infrared lighting unit 1130 may provide the first infraredrays to the subject (e.g., the first infrared lighting unit 1130 mayirradiate the subject with the first infrared rays) during a relativelylong period of time to measure a distance of the subject in real time.To provide the first infrared rays during a relatively long period oftime, the first infrared lighting unit 1130 may provide the firstinfrared rays to the subject such that the first infrared rays arerelatively low power infrared rays.

According to at least some example embodiments of the inventiveconcepts, the second infrared lighting unit 1140 may be used foroperations including any or all of the following: face recognition, irisrecognition, and three-dimensional (3D) recognition of a subject. In alow-illuminance environment, to sense the subject, the mono image sensor1120 senses second infrared light reflected from the subject. The secondinfrared light is infrared light reflected from the subject, based onthe second infrared rays. In the low-illuminance environment such asnight or an interior in which a light does not exist, in the case ofsensing a part of the subject such as an iris, the second infraredlighting unit 1140 provides the second infrared rays to the subject(e.g., the second infrared lighting unit 1140 irradiates the subjectwith the second infrared rays). In the case of using the visible light,exact image detection may be difficult due to dazzling. For this reason,the second infrared lighting unit 1140 provides the second infrared raysof the infrared band.

When the second infrared rays are provided to a user wearing glasses foriris recognition, the second infrared light may be reflected from theglasses. When the second infrared lighting unit 1140 (e.g., an infraredlight source of the second infrared lighting unit 1140) and the monoimage sensor 1120 are arranged adjacent to each other, the secondinfrared light reflected from the glasses may reach the mono imagesensor 1120, thereby making exact image detection difficult. Also, whenthe second infrared lighting unit 1140 (e.g., an infrared light sourceof the second infrared lighting unit 1140) and the mono image sensor1120 are arranged adjacent to each other, the second infrared light maybe reflected from capillaries behind the retina, thereby causing theredeye effect. Accordingly, the second infrared lighting unit 1140(e.g., an infrared light source of the second infrared lighting unit1140) and the mono image sensor 1120 may be arranged to be spaced apartfrom each other by a specific distance. According to at least someexample embodiments of the inventive concepts, a distance between thefirst infrared lighting unit 1130 (e.g., an infrared light source of thefirst infrared lighting unit 1130) and the mono image sensor 1120 may beshorter than a distance between the second infrared lighting unit 1140(e.g., an infrared light source of the second infrared lighting unit1140) and the mono image sensor 1120.

According to at least some example embodiments of the inventiveconcepts, the second infrared lighting unit 1140 may provide the secondinfrared rays to the subject such that the second infrared rays arerelatively high power infrared rays so as to sense the subject at a longdistance. For example, the second infrared rays may be provided by thesecond infrared lighting unit 1140 with a higher level of power than thelevel of power with which the first infrared rays are provided by thefirst infrared lighting unit 1130.

The image signal processor 1150 may control the color image sensor 1110,the mono image sensor 1120, the first infrared lighting unit 1130, andthe second infrared lighting unit 1140 and may process various data. Theimage signal processor 1150 may perform various image processingoperations based on pieces of data that the color image sensor 1110 andthe mono image sensor 1120 provide and may provide the image-processeddata to the application processor 1200. As used herein, the terms“piece” or “pieces” used with respect to data refer to units (e.g.,portions, fragments, blocks, chunks and/or bytes [e.g., kilobytes KB,megabytes MB, gigabytes GB, etc.]) of data.

The image signal processor 1150 may receive the color image data CIDfrom the color image sensor 1110 and may measure an illuminance valuebased on the color image data CID. The image signal processor 1150 maymeasure a distance of the subject based on the infrared image data MIDcorresponding to the first infrared light from the mono image sensor1120. The image signal processor 1150 may obtain an identification imageof the subject based on the illuminance value, the distance value, andthe infrared image data MID corresponding to the second infrared light.

The application processor 1200 may control the image detecting system1000 and may process various data. The application processor 1200 mayexecute an operating system and various applications. The applicationprocessor 1200 and the image signal processor 1150 are illustrated inFIG. 1 as being separated from each other. However, at least someexample embodiments of the inventive concepts are not limited to theexample arrangement illustrated in FIG. 1. For example, the applicationprocessor 1200 and the image signal processor 1150 may be integrated inone chip.

The display 1300 may receive and display data that is generated by theimage detecting device 1100 or data that is stored in the storage device1400 or the RAM 1500. The display 1300 may be, or include, a displaydevice examples of which include, but are not limited to, a liquidcrystal display (LCD), an organic light-emitting diode (OLED) display,an active matrix OLED (AMOLED) display, a flexible display, and anelectronic ink display.

According to at least some example embodiments of the inventiveconcepts, the storage device 1400 may be used as an auxiliary memory ofthe application processor 1200. For example, source codes of variousapplications, an operating system executable by the applicationprocessor 1200, data generated by the operating system, and/or datagenerated by applications for long-term storage may be stored in thestorage device 1400. The storage device 1400 may be, or include, astorage device examples of which include, but are not limited to, aflash memory, a phase change RAM (PRAM), a magnetic RAM (MRAM), aferroelectric RAM (FRAM), and a resistive RAM (RRAM).

The RAM 1500 may be used as a main memory of the application processor1200. For example, the RAM 1500 may store various data processed by theprocessor 1200 and process codes. According to at least some exampleembodiments of the inventive concepts, the RAM 1500 may include, forexample, one or more of a dynamic RAM (DRAM), a static RAM (SRAM), aPRAM, an MRAM, an FRAM, and an RRAM.

The modem 1600 may communicate with an external device. For example, themodem 1600 may perform communication based one or more of variouswireless communication technologies including, for example, long termevolution (LTE), code division multiple access (CDMA), Bluetooth, nearfield communication (NFC), wireless fidelity (Wi-Fi), and radiofrequency identification (RFID), and/or one or more of various wiredcommunication technologies including, for example, universal serial bus(USB), serial AT attachment (SATA), serial peripheral interface (SPI),inter-integrated circuit (I2C), HS-I2C, and integrated-interchip sound(I2S).

FIG. 2 is a block diagram illustrating a color image sensor and an imagesignal processor, according to at least some example embodiments of theinventive concepts.

Referring to FIG. 2, the color image sensor 1110 includes a color pixelarray 1111, a color sensor row driver 1112, a color sensor column sensecircuit 1113, and a color sensor timing controller 1114. According to atleast some example embodiments of the inventive concepts, the colorimage sensor 1110 may be, for example, a charge coupled device (CCD)image sensor or a complementary metal-oxide-semiconductor (CMOS) imagesensor (CIS).

The color pixel array 1111 may include a plurality of pixels. Each pixelmay include a plurality of unit pixels. For example, each pixel mayinclude four unit pixels. In detail, each pixel may include a red pixelR1, a first green pixel G1, a second green pixel G2, and a blue pixelB1. Each unit pixel may include a color filter. Unlike that exampleillustrated in FIG. 2, each pixel of the color pixel array 1111 may becomposed of three unit pixels, instead of four. However, at least someexample embodiments of the inventive concepts are not limited to pixelseach including three or four unit pixels, and each pixel may includeless than three or more than four unit pixels. Further, according to atleast some example embodiments of the inventive concepts, each unitpixel may include a unit pixel circuit, for example, in accordance withknown structures for unit pixel circuits of CCD or CMOS image sensors,and each unit pixel may convert an input light signal into an electricalsignal. For example, each unit pixel circuit may convert an input lightsignal into an electrical signal.

The color sensor row driver 1112 may control an operation of the colorpixel array 1111. The color sensor row driver 1112 may generate a rowselection signal and may provide the row selection signal to the colorpixel array 1111. The color pixel array 1111 may provide an electricalsignal from a row, which is selected by the row selection signal, to thecolor sensor column sense circuit 1113.

The color sensor column sense circuit 1113 senses electrical signalsfrom unit pixels. The color sensor column sense circuit 1113 may convertthe electrical signals into the color image data CID by performing ananalog-digital conversion operation. The color sensor column sensecircuit 1113 provides the color image data CID to the image signalprocessor 1150.

The color sensor timing controller 1114 may be a circuit or circuitrythat controls an operation of the color image sensor 1110. The colorsensor timing controller 1114 may drive the color image sensor 1110 byproviding control signals to the color sensor row driver 1112 and thecolor sensor column sense circuit 1113.

According to at least some example embodiments of the inventiveconcepts, the image signal processor 1150 includes a color imagecorrection unit 1151, an illuminance calculation unit 1152, and an autoexposure controller 1153, each of which may be implemented, for example,by circuitry and/or software or firmware executed by the image signalprocessor 1150. For example, according to at least some exampleembodiments of the inventive concepts, the image signal processor 1150may be or include a microprocessor that executes instructions (e.g.,program code included in software or firmware stored in storageaccessible by the image signal processor 1150) for implementing theoperations of the color image correction unit 1151, illuminancecalculation unit 1152, and/or auto exposure controller 1153.

The color image correction unit 1151 receives the color image data CIDfrom the color image sensor 1110 and may generate color thumbnail dataCTD by sub-sampling the color image data CID. In detail, the color imagecorrection unit 1151 may generate the color thumbnail data CTD byperforming a crop operation and a sub-sampling operation on the colorpixel array 1111.

For example, the color image correction unit 1151 may receive the colorimage data CID corresponding to “1280×720” pixels from the color sensorcolumn sense circuit 1113 and may select the color image data CIDcorresponding to “1280×704” pixels. Also, the color image correctionunit 1151 may selectively receive the color image data CID correspondingto “1280×704” pixels from the color sensor column sense circuit 1113.The color image correction unit 1151 may generate “128×64” pieces ofcolor thumbnail data CTD by sub-sampling each row of the color imagedata CID corresponding to “1280×704” pixels with a rate of 1/10 andsub-sampling each column thereof with a rate of 1/11. Each of the“128×64” pieces of color thumbnail data CTD may be formed to correspondto four unit pixels: the red pixel R1, the first green pixel G1, thesecond green pixel G2, and the blue pixel B1.

According to at least some example embodiments of the inventiveconcepts, power consumption of the image detecting device 1100 may bereduced by generating the color thumbnail data CTD based on the cropoperation and the sub-sampling operation.

The illuminance calculation unit 1152 measures an ambient illuminancevalue based on the color thumbnail data CID generated in the color imagecorrection unit 1151. The illuminance value may be proportional to a sumof luminance values of all pieces of color thumbnail data CTD. That is,the illuminance value is expressed by the following equation.

$\begin{matrix}{{{Lux}\mspace{14mu} {value}} = \frac{\left( {{AF} \times {YD}} \right)}{\left( {{AG} \times {IT}} \right)}} & \left\lbrack {{Equation}\mspace{14mu} 1} \right\rbrack\end{matrix}$

In Equation 1, “Lux value” indicates the illuminance value, “YD”indicates a luminance value of all pieces of color thumbnail data CTD,“AF” indicates a correction coefficient, “AG” indicates an analog gain,and “IT” indicates an exposure time. The analog gain AG means a gainwhen the color sensor column sense circuit 1113 performs ananalog-digital conversion operation. The exposure time IT means a timewhen the color pixel array 1111 is exposed to light.

The illuminance calculation unit 1152 provides illuminance data LD tothe auto exposure controller 1153 based on the illuminance value. Also,although not illustrated in FIG. 2, the illuminance calculation unit1152 may provide the illuminance data LD or pieces of color thumbnaildata CTD to any other element of the image signal processor 1150 or tothe application processor 1200.

The auto exposure controller 1153 may provide an exposure time controlsignal ITS to the color sensor timing controller 1114 based on theilluminance data LD. For example, a light integration time of unitpixels may decrease as an illuminance value corresponding to theilluminance data LD increases. Accordingly, the auto exposure controller1153 may control an exposure time by providing the exposure time controlsignal ITS to the color sensor timing controller 1114.

The image detecting device 1100 according to at least some exampleembodiments of the inventive concepts may calculate an illuminance valueby using the color image sensor 1110 without a separate illuminancesensor. Accordingly, the image detecting device 1100 may make itpossible to reduce the number of holes that are provided in the imagedetecting device 1100 or the image detecting system 1000 for theilluminance sensor.

FIG. 3 is a block diagram illustrating a mono image sensor, first andsecond infrared lighting units, and an image signal processor, accordingto at least some example embodiments of the inventive concepts. FIG. 4is a drawing for describing a method of measuring a distance by using amono image sensor, according to at least some example embodiments of theinventive concepts.

Referring to FIG. 3, the mono image sensor 1120 includes a mono pixelarray 1121, a mono sensor row driver 1122, a mono sensor column sensecircuit 1123, and a mono sensor timing controller 1124. According to atleast some example embodiments of the inventive concepts, the mono imagesensor 1120 may be, for example, a CCD image sensor or a CMOS imagesensor.

The mono pixel array 1121 may include a plurality of pixels. Unlike thecolor pixel array 1111, the mono pixel array 1121 may include pixelsthat sense light of the same band. In detail, each pixel may sense lightof an infrared band. The mono sensor array 1121 may include an infraredpass filter. Each pixel may include a pixel circuit, in accordance withknown pixel circuits of CCD or CMOS image sensors, that converts aninput light signal into an electrical signal.

The mono sensor row driver 1122 may control an operation of the monopixel array 1121. The mono sensor row driver 1122 may generate a rowselection signal and may provide the row selection signal to the monopixel array 1121.

The mono sensor column sense circuit 1123 senses electrical signals fromthe mono pixel array 1121. The mono sensor column sense circuit 1123 mayconvert the electrical signals into infrared image data MID byperforming an analog-digital conversion operation. The mono sensorcolumn sense circuit 1123 provides the infrared image data MID to theimage signal processor 1150.

The mono sensor timing controller 1124 may control an operation of themono image sensor 1120. The mono sensor timing controller 1124 may drivethe mono image sensor 1120 by providing a control signal to the monosensor row driver 1122 and the mono sensor column sense circuit 1123.Also, the mono sensor timing controller 1124 drives the first infraredlighting unit 1130 and the second infrared lighting unit 1140 byproviding a control signal to a first infrared lighting unit driver 1131and a second infrared lighting unit driver 1141.

In detail, the mono sensor timing controller 1124 may synchronize asense time of the mono image sensor 1120 with a time during which thefirst infrared lighting unit 1130 or the second infrared lighting unit1140 provides infrared rays. That is, the mono sensor timing controller1124 may synchronize light driving timing with sensor driving timing toprevent the amount of light practically provided to the mono imagesensor 1120 from be measured differently due to a turn-off state of thefirst infrared lighting unit 1130 or the second infrared lighting unit1140 while the mono image sensor 1120 sequentially senses lightcorresponding to mono pixels. Also, the synchronization makes itpossible to prevent a rolling shutter phenomenon due to a rapid changein light during a sensing operation of the mono image sensor 1120. Sincean illumination providing time of the first infrared lighting unit 1130or an illumination providing time of the second infrared lighting unit1140 are synchronized with the sense time of the mono image sensor 1120by the mono sensor timing controller 1124, there is no need tocontinuously provide illumination, thereby reducing power consumption.

The image signal processor 1150 includes a mono image correction unit1156 and a distance calculation unit 1157, each of which may beimplemented, for example, by circuitry and/or software or firmwareexecuted by the image signal processor 1150. For example, according toat least some example embodiments of the inventive concepts, the imagesignal processor 1150 may be or include a microprocessor that executesinstructions (e.g., program code included in software or firmware storedin storage accessible by the image signal processor 1150) forimplementing the operations of the mono image correction unit 1156and/or distance calculation unit 1157.

The mono image correction unit 1156 receives the infrared image data MIDfrom the mono image sensor 1120 and may correct the infrared image dataMID to generate mono thumbnail data MTD. In detail, the mono imagecorrection unit 1156 may generate the mono thumbnail data MTD byperforming a crop operation and a sub-sampling operation on the monopixel array 1121. Power consumption of the image detecting device 1100may be reduced by generating the mono thumbnail data MTD based on thecrop operation and the sub-sampling operation.

According to at least some example embodiments of the inventiveconcepts, the mono image sensor 1120 senses the first infrared light orthe second infrared light reflected from the subject to output firstinfrared image data MID1. When the first infrared lighting unit 1130 andthe second infrared lighting unit 1140 do not operate, the mono imagesensor 1120 senses infrared light reflected from the subject to outputsecond infrared image data MID2.

According to at least some example embodiments of the inventiveconcepts, the mono image correction unit 1156 may correct the firstinfrared image data MID1 to generate first thumbnail data MTD1, and themono image correction unit 1156 may correct the second infrared imagedata MID2 to generate second thumbnail data MTD2.

The distance calculation unit 1157 may calculate a distance between thesubject and the mono image sensor 1120 (i.e., a distance value dd) basedon the first mono thumbnail data MTD1 and the second mono thumbnail dataMTD2.

The distance calculation unit 1157 may provide distance data SDD to themono sensor timing controller 1124 based on the distance value dd.Further, although not illustrated in FIG. 3, the distance calculationunit 1157 may provide the distance data SDD or the first and second monothumbnail data MTD1 and MTD2 to any other element of the image signalprocessor 1150 or to the application processor 1200. The mono sensortiming controller 1124 may selectively drive the mono image sensor 1120,the first infrared lighting unit 1130, and the second infrared lightingunit 1140 based on the distance data SDD.

The first infrared lighting unit 1130 may include the first infraredlighting unit driver 1131 and a first infrared lighting unit source1132. The second infrared lighting unit 1140 may include a secondinfrared lighting unit driver 1141 and a second infrared lighting unitsource 1142. The first and second infrared lighting unit sources 1132and 1142 may be implemented by, for example, infrared (IR) emitters.

The first infrared lighting unit driver 1131 may control driving of thefirst infrared lighting unit source 1132. The second infrared lightingunit driver 1141 may control driving of the second infrared lightingunit source 1142. Unlike those illustrated in FIG. 3, the first infraredlighting unit driver 1131 and the second infrared lighting unit driver1141 may be arranged in the image signal processor 1150 or theapplication processor 1200. Also, the mono sensor timing controller 1124may drive the first infrared lighting unit 1132 and the second infraredlighting unit 1142 without the first infrared lighting unit driver 1131and the second infrared lighting unit driver 1141.

Referring to FIG. 4, the first infrared lighting unit 1130 of the imagedetecting device 1100 provides the first infrared rays to a user. Thefirst infrared rays are incident on the subject. And the first infraredlight is reflected from the user. The mono image sensor 1120 senses thereflected first infrared light. The mono image sensor 1120 may measurethe distance value dd between the user and the mono image sensor 1120based on a light intensity Ion of the first infrared light. A distancebetween the user and the mono image sensor 1120, that is, the distancevalue dd is expressed by the following equation.

$\begin{matrix}{{dd} \propto \left( \frac{RC}{{Ion} - {Ioff}} \right)^{0.5}} & \left\lbrack {{Equation}\mspace{14mu} 2} \right\rbrack\end{matrix}$

Referring to Equation 2, the distance value dd is inversely proportionalto a square root of a difference between the light intensity Ion of thereflected first infrared light and the intensity Ioff of light reflectedfrom the user when the first infrared lighting unit 1130 is at an offstate. The difference between the light intensity Ion of the firstinfrared light and the intensity Ioff of light reflected from the userwhen the first infrared lighting unit 1130 is at an off state may becalculated based on a difference between the first mono thumbnail dataMTD1 and the second mono thumbnail data MTD2. A reflection coefficientRC means an amplitude ratio of light incident to the user and lightreflected therefrom.

FIG. 5 is a flowchart illustrating a method of detecting an image byusing an image detecting device, according to at least some exampleembodiments of the inventive concepts. FIG. 6 is a flowchartillustrating a method of obtaining an identification image, according toat least some example embodiments of the inventive concepts.

Referring to FIG. 5, a method S1000 of detecting an image by using theimage detecting device 1100 includes providing first infrared rays(S100), synchronizing a sense time of a mono image sensor with a time toprovide the first infrared rays (S200), generating first infrared imagedata (S300), generating second infrared image data (S400), measuring adistance of a subject (S500), determining whether the distance of thesubject is within a reference range (S600), and obtaining anidentification image (S700).

In operation S100, the first infrared lighting unit 1130 provides thefirst infrared rays to the subject. The first infrared light reach themono image sensor 1120 after the first infrared rays being incident onthe subject and the first infrared light being reflected from thesubject.

In operation S200, the mono image sensor 1120 senses the first infraredlight reflected from the subject. In this case, as described above, atime to provide the first infrared rays and a sense time of the monoimage sensor 1120 may be synchronized to reduce power consumption of theimage detecting device 1100, to prevent the rolling shutter phenomenon,and to obtain exact data.

In operation S300, the mono image sensor 1120 senses the first infraredlight and/or the second infrared light reflected from the subject togenerate the first infrared image data MID1.

In operation S400, the mono image sensor 1120 senses a third infraredlight, which are reflected from the subject when the first infrared raysand the second infrared rays are not provided, to generate the secondinfrared image data MID2.

In operation S500, the image signal processor 1150 measures a distanceof the subject based on the first infrared image data MID1 and thesecond infrared image data MID2. Operation S500 includes correcting thefirst infrared image data MID1 to generate the first mono thumbnail dataMTD1, correcting the second infrared image data MID2 to generate thesecond mono thumbnail data MTD2, and calculating the distance value ddcorresponding to a distance between the subject and the mono imagesensor 1120 based on the first mono thumbnail data MTD1 and the secondmono thumbnail data MTD2.

In operation S600, the image signal processor 1150 or the applicationprocessor 1200 determines whether the distance value dd is within thereference range. For example, the reference range may be set to 20 to 25cm for iris recognition. For the iris recognition, the distance value ddthat is defined such that a diameter of an iris image has a valuecorresponding to 100 to 200 pixels or more may be the reference range.Also, for face recognition, the reference range may be defined to haveabout 25 cm or more.

If the distance value dd is not within the reference range, since it maybe more difficult to obtain an identification image through the imagedetecting device 1100 at a distance outside the reference range, theprocess (i.e., the image detecting device 1100 and/or image detectingsystem 1000) returns to operation S100 to provide the first infraredrays. The image detecting system 1000 may provide, through the display1300, a message that allows the user to be placed within the referencerange.

If the distance value dd is within the reference range, the processproceeds to operation S700. In operation S700, the mono image sensor1120 may sense the subject to generate a portion of image data, and theimage signal processor 1150 may obtain the identification image based onthe portion of the image data.

Referring to FIG. 6, operation S700 includes generating color image data(S710), measuring an illuminance value (S720), determining whether anilluminance value is less than or equal to a reference value (S730),providing second infrared rays (S740), and sensing a part of the subject(S750).

In operation S710, the color image sensor 1110 senses visible light togenerate the color image data CID.

In operation S720, the image signal processor 1150 measures theilluminance value based on the color image data CID. Operation S720includes sub-sampling the color image data CID to generate colorthumbnail data and calculating an illuminance value based on the colorthumbnail data.

In operation S730, the image signal processor 1150 or the applicationprocessor 1200 determines whether the illuminance value is not more thanthe reference value. A relatively low or, alternatively, minimumbrightness for sensing a part of the subject such as user's iris or facemay correspond to a reference value of the illuminance value.

If the illuminance value is not more than the reference value, since itmay be more difficult for the image detecting device 1100 to sense thesubject in a low-illuminance environment, the process (i.e., the imagedetecting device 1100 and/or image detecting system 1000) proceeds tooperation S740. If the illuminance value is greater than the referencevalue, since it may be easier for the image detecting device 1100 tosense the subject in a higher-illuminance environment, the process(i.e., the image detecting device 1100 and/or image detecting system1000) proceeds to operation S750 to sense a part of the subject.

In operation S740, the second infrared lighting unit 1140 provides thesecond infrared rays to the subject (e.g., by irradiating the subjectwith the second infrared rays). The second infrared light reaches themono image sensor 1120 after the second infrared rays being incident onthe subject and the second infrared light being reflected from thesubject. It may be possible to sense the subject in the low-illuminanceenvironment through the second infrared rays.

In operation S750, the mono image sensor 1120 senses the second infraredlight reflected from the subject to recognize a part of the subject. Thepart of the subject may include, but is not limited to, the user's faceor iris. The image signal processor 1150 may obtain the identificationimage based on the part of the subject thus recognized.

FIG. 7 is a block diagram illustrating an image detecting system 2000,according to at least another example embodiment of the inventiveconcepts.

Referring to FIG. 7, the image detecting system 2000 includes an imagedetecting device 2100, an application processor 2200, a display 2300, astorage device 2400, a RAM 2500, and a modem 2600. Features andfunctions of the application processor 2200, the display 2300, thestorage device 2400, the RAM 2500, and the modem 2600 are similar tothose of corresponding elements of FIG. 1, and a detailed descriptionthereof is thus omitted.

The image detecting device 2100 includes a color image sensor 2110, amono image sensor 2120, an infrared lighting unit 2130, and an imagesignal processor 2140.

The color image sensor 2110 senses visible light to generate the colorimage data CID. The mono image sensor 2120 generates the mono image dataMID. As is discussed in greater detail below, the mono image sensor 2120has an infrared pass mode for sensing infrared light and an infraredcut-off mode for cutting off infrared light.

The infrared lighting unit 2130 provides infrared rays that are incidenton, the subject. And the infrared light that is reflected from thesubject, based on the infrared rays, reaches the mono image sensor 2120,in the infrared pass mode. FIG. 7 shows one infrared lighting unit 2130.However, at least some example embodiments of the inventive concepts arenot limited to an arrangement including only one infrared lighting unit2130. For example, the infrared lighting unit 2130 may include aplurality of lighting units.

The image signal processor 2140 receives the color image data CID fromthe color image sensor 2110 and receives the mono image data MID fromthe mono image sensor 2120. In the infrared cut-off mode, the imagesignal processor 2140 measures a distance of the subject based on thecolor image data CID and the mono image data MID. In the infrared passmode, the image signal processor 2140 may sense a part of the subjectbased on the mono image data MID by the infrared lighting unit 2130 andmay generate an identification image based on the sensed result.

FIG. 8 is a sectional view of the color image sensor 2110 of FIG. 7, andFIG. 9 is a sectional view of the mono image sensor 2120 of FIG. 7.

Referring to FIG. 8, the color image sensor 2110 includes a first pixel2111, a color filter 2112, a microlens 2113, an infrared cut-off filter2114, and an outer lens 2115. According to at least some exampleembodiments of the inventive concepts, the color image sensor 2110 maybe, for example, a CCD image sensor or a CMOS image sensor.

Only one first pixel 2111 is illustrated in FIG. 8, but the color imagesensor 2110 may include a plurality of first pixels 2111, for example,arranged in a pixel array. The first pixel 2111 may convert an inputlight signal into an electrical signal. Only one color filter 2112 isillustrated in FIG. 8, but the color image sensor 2110 may include aplurality of color filters 2112. The color filter 2112 passes light of aspecific band of a visible band and cuts off light of the rest thereof.The color filter 2112 may be any one of a red color filter, a greencolor filter, and a blue color filter and may be arranged on the firstpixel 2111. Light of a band corresponding to one of red, green, and blueis transmitted to the first pixel 2111 through the color filter 2112.However, at least some example embodiments of the inventive concepts arenot limited thereto. For example, light of a band corresponding to oneof cyan, magenta, and yellow may be transmitted to the first pixel 2111.

The microlens 2113 may be provided in plurality and the plurality ofmicrolenses may be arranged on the color filter 2112. The microlens 2113concentrates light incident on the first pixel 2111, thus increasing asensing effect of the first pixel 2111. The outer lens 2115 refractslight from the subject and may allow an image to be focused in the firstpixel 2111.

The infrared cut-off filter 2114 is arranged on the microlens 2113.Since the infrared cut-off filter 2114 cuts off infrared light, noisemay be reduced, and color reproduction may be improved. The infraredcut-off filter 2114 may be fixed to the color image sensor 2110.

Referring to FIG. 9, the mono image sensor 2120 includes a second pixel2121, a microlens 2122, an infrared cut-off filter 2123, an infraredpass filter 2124, an outer lens 2125, and an actuator 2126. According toat least some example embodiments of the inventive concepts, the monoimage sensor 2120 may be, for example, a CCD image sensor or a CMOSimage sensor.

Only one second pixel 2121 is illustrated in FIG. 9, but the mono imagesensor 2120 may include a plurality of second pixels 2121. The secondpixel 2121 may convert an input light signal into an electrical signal.Unlike the color image sensor 2110, the mono image sensor 2120 does notinclude a color filter.

The infrared cut-off filter 2123 and the infrared pass filter 2124 areselectively arranged on or over the second pixel 2121 and the microlens2122. For example, as is discussed in greater detail below, the imagedetecting device 2100 may switch, selectively, between arranging theinfrared cut-off filter 2123 on or over the second pixel 2121 andarranging the infrared pass filter 2124 on or over the second pixel2121. The infrared cut-off filter 2123 cuts off infrared light, and theinfrared pass filter 2124 passes the infrared light. The infrared passfilter 2124 may be a band-pass filter. The infrared cut-off filter 2123and the infrared pass filter 2124 may be arranged on the same layer andmay be formed to be connected to each other.

The actuator 2126 may allow one of the infrared cut-off filter 2123 andthe infrared pass filter 2124 to be arranged over the second pixel 2121.The actuator 2126 may include a motor and may determine a filter to bearranged over the second filter 2121 based on a mode selection signalfrom the image signal processor 2140.

For example, when the infrared cut-off filter 2123 is arranged over thesecond pixel 2121, the image detecting device 2100 operates in theinfrared cut-off mode. Further, when the infrared pass filter 2124 isarranged over the second pixel 2121, the image detecting device 2100operates in the infrared pass mode.

FIG. 10 is a block diagram illustrating an image detecting device in aninfrared cut-off mode. FIGS. 11 and 12 are drawings for describing amethod of measuring a distance of a subject in an infrared cut-off mode.

Referring to FIG. 10, the infrared cut-off filter 2123 is arranged on orover the second pixel 2121. In this case, the mono image sensor 2120fails to sense infrared light, and the image detecting device 2100operates in the infrared cut-off mode. Since it is impossible to sensethe infrared light, the infrared lighting unit 2130 is turned off, whichis expressed by hatching.

Each of the color image sensor 2110 and the mono image sensor 2120 maysense visible light. The color image sensor 2110 may sense light of aband corresponding to a specific color, for example, through use of acolor filter arranged above one or more pixels of the color image sensor2110, and the mono image sensor 2120 may be viewed as including a whitepixel.

Referring to FIG. 11, according to at least some example embodiments ofthe inventive concepts, the color image sensor 2110 and the mono imagesensor 2120 may be spaced apart from each other by a distance. Each ofthe color image sensor 2110 and the mono image sensor 2120 may senselight reflected from the user. The mono image sensor 2120 may have afirst angle of view a1, and the color image sensor 2110 may have asecond angle of view a2. The color image data CID sensed by the colorimage sensor 2110 and the mono image data MID sensed by the mono imagesensor 2120 may be matched to measure a distance between the user andthe image detecting device 2100. To match the color image data CID andthe mono image data MID, the size of an image sensed by the color imagesensor 2110 and the size of an image sensed by the mono image sensor2120 may be equalized. Accordingly, the first angle of view a1 and thesecond angle of view a2 may have the same value.

Referring to FIG. 12, a first image I1 sensed by the mono image sensor2120 and a second image I2 sensed by the color image sensor 2110 arematched. The image signal processor 2140 calculates a difference betweenthe first image I1 corresponding to the mono image data MID and thesecond image I2 corresponding to the color image data CID. Thedifference may be calculated on the basis of a distance difference d1between pupils of the images I1 and I2.

In detail, the first image I1 and the second image I2 are different fromeach other because they are respectively obtained through sensors ofwhich the sense bands are different from each other. However, referringto FIG. 2, the image signal processor 2140 may calculate brightnessinformation of the second image I2 by using the color image data CIDsensed by the color image sensor 2110. Also, the image signal processor2140 may calculate brightness information of the first image I1 based onthe mono image data MID. In the case where a separate light does notexist, the user's pupil may belong to a darkest area. The pupil absorbsall light if illumination is not direct light illumination. Accordingly,it may be assumed that an area (or areas) of which the brightness is thelowest corresponds to a user's pupil (or pupils). The image signalprocessor 2140 may determine areas corresponding to the pupils in thefirst image I1 and the second image I2 and may calculate the distancedifference between the pupils.

The image signal processor 2140 may calculate a distance between theimage detecting device 2100 and the user based on the distancedifference d1 between the pupils. The distance value may be calculatedon the basis of preset calibration information.

Further, according to at least some example embodiments of the inventiveconcepts, in the infrared cut-off mode, the image signal processor 2140may improve the quality of an image based on a stereoscopic camera in alow-illuminance environment by using the color image sensor 2110 and themono image sensor 2120. In the low-illuminance environment, the imagesignal processor 2140 may improve the quality of image by a combinationwith the color image data CID by using brightness information of themono image sensor 2120.

FIG. 13 is a block diagram illustrating the image detecting device 2110in an infrared pass mode.

Referring to FIG. 13, the infrared pass filter 2124 is arranged on orover the second pixel 2121. In this case, the mono image sensor 2120 maysense infrared light, and the image detecting device 2100 operates inthe infrared pass mode. The infrared lighting unit 2130 may be turnedon.

The infrared pass mode may be changed from the infrared cut-off modebased on a distance value between the image detecting device 2100 andthe subject. For example, for iris recognition, when the distance valueis determined such that an iris diameter has at least 100 to 200 pixels,the image signal processor 2140 may switch from the infrared cut-offmode to the infrared pass mode.

The infrared lighting unit 2130 provides infrared rays. The infraredlight reaches the mono image sensor 2120 after the infrared rays beingincident on the subject and the infrared light being reflected from thesubject. The mono image sensor 2120 may sense the subject based on themono image data MID obtained through the infrared lighting unit 2130.The mono image sensor 2120 may sense the subject by using the infraredlighting unit 2130 even in a low-illuminance environment such as nightor a dark interior. However, in the case where a separate light exists,pseudo color image data may be generated by combining the color imagedata CID obtained through the color image sensor 2110 and the mono imagedata MID.

FIG. 14 is a flowchart illustrating a method of detecting an image byusing an image detecting device, according to at least another exampleembodiment of the inventive concepts.

Referring to FIG. 14, a method 52000 of detecting an image by using theimage detecting device 2100 includes activating an infrared cut-off mode(S2100), generating mono image data and color image data (S2200),measuring a distance of a subject (S2300), determining whether adistance value of the subject is less than or equal to a reference value(S2400), activating an infrared pass mode (S2500), and generating anidentification image (S2600).

In operation S2100, the infrared cut-off filter 2123 is arranged on orover the second pixel 2121. The infrared lighting unit 2130 may beturned on.

In operation S2200, the color image sensor 2110 and the mono imagesensor 2120 sense light reflected from the subject. The image signalprocessor 2140 generates the color image data CID based on an electricalsignal received from the color image sensor 2110 and generates the monoimage data MID based on an electrical signal received from the monoimage sensor 2120.

In operation S2300, the image signal processor 2140 measures a distanceof the subject based on the color image data CID and the mono image dataMID. Operation S2300 includes matching the color image data CID and themono image data MID, extracting a difference value between the colorimage data CID and the mono image data MID, and calibrating thedifference value to calculate a distance between the subject and theimage detecting device 2100. The difference value may correspond to, forexample, a disparity between an image corresponding to the color imagedata CID and an image corresponding to the mono image data MID.

In operation S2400, the image signal processor 2140 or the applicationprocessor 2200 determines whether the distance between the subject andthe image detecting device 2100 is not more than a reference value. Forexample, the reference range may be set to 20 to 25 cm for irisrecognition.

If the distance, that is, the distance value dd is greater than thereference value, it is difficult to recognize a part of the subject. Inthis case, the process proceeds to operation S2100 to maintain theinfrared cut-off mode. The image detecting system 2000 may provide,through the display 2300, a message that allows the user to be placedwithin a reference range.

If the distance value dd is not more than the reference value, theprocess proceeds to operation S2500 to activate the infrared pass mode.In operation S2500, the infrared pass filter 2124 is arranged on or overthe second pixel 2121. The infrared lighting unit 2130 may be turned on.The infrared lighting unit 2130 may provide infrared rays to thesubject. The infrared light reaches the mono image sensor 2120 after theinfrared rays being incident on the subject and the infrared light beingreflected from the subject. The infrared rays may make it possible tosense the subject in the low-illuminance environment.

In operation S2600, the mono image sensor 2120 senses the secondinfrared light reflected from the subject to recognize a part of thesubject. The part of the subject may include, but not limited to, user'sface or iris. The image signal processor 2140 obtains the identificationimage based on the sensed subject. Also, the image signal processor 2140may improve the quality of image by a combination with the color imagedata CID obtained through color image sensor 2110.

FIG. 15 is a block diagram illustrating an image signal processor 3150,according to at least some example embodiments of the inventiveconcepts. The image signal processor 3150 of FIG. 15 may be an exampleimplementation of the image signal processor 1150 included in the imagedetecting device 1100 of FIG. 1 and/or the image signal processor 2140included in the image detecting device 2100 of FIG. 7.

Referring to FIG. 15, the image signal processor 3150 may include a modeselection unit 3151, an illuminance measurement unit 3152, a distancemeasurement module 3153, an image obtaining module 3154, and acompression unit 3159 each of which may be implemented, for example, bycircuitry and/or software or firmware executed by the image signalprocessor 3150. The image obtaining module 3154 may include a normalimage obtaining module 3155, an iris recognition module 3156, a facerecognition module 3157, and a three-dimensional (3D) image obtainingmodule 3158 each of which may be implemented, for example, by circuitryand/or software or firmware executed by the image signal processor 3150.According to at least some example embodiments of the inventiveconcepts, the image signal processor 3150 may be or include amicroprocessor that executes instructions (e.g., program code includedin software or firmware stored in storage accessible by the image signalprocessor 3150) for implementing the operations of the mode selectionunit 3151, illuminance measurement unit 3152, distance measurementmodule 3153, image obtaining module 3154, compression unit 3159, normalimage obtaining module 3155, iris recognition module 3156, facerecognition module 3157, and/or three-dimensional (3D) image obtainingmodule 3158. The mode selection unit 3151 receives the color image dataCID or the infrared image data (mono image data) MID. The mode selectionunit 3151 may provide the received data to one of the illuminancemeasurement module 3152, the distance measurement module 3153, and theimage obtaining module 3154. The module selection unit 3151 may includea switch and may be selectively connected to each module of the imagesignal processor 3150.

The mode selection unit 3151 may determine an illuminance measurementmode for measuring an illuminance value Lux value, a distancemeasurement mode for measuring a distance value dd, an identificationimage detection mode for obtaining the identification image, and anormal image detection mode for obtaining the color image data CID.Also, the identification image detection mode may include an irisrecognition mode for recognizing an iris of the user, a face recognitionmode for recognizing a face of the user, and a 3D image obtaining modeusing a dual image sensor.

The infrared cut-off mode of FIG. 10 may correspond to the normal imagedetection mode in the case of improving the quality of image and maycorrespond to the distance measurement mode in the case of measuring adistance. The infrared pass mode of FIG. 13 may correspond to theidentification image detection mode.

In the illuminance measurement mode, the mode selection unit 3151 isconnected with the illuminance measuring module 3152. The illuminancemeasurement module 3152 may include the color image correction unit1151, an illuminance calculation unit 1152, and the auto exposurecontroller 1153 of FIG. 2 and may output illuminance data LD by usingthe color image data CID. When an illuminance value is not more than areference value, the second infrared lighting unit 1140 of FIG. 1 or theinfrared lighting unit 2130 of FIG. 7 may be activated. In this case,the mode selection unit 3151 may switch to the identification imagedetection mode to recognize iris, face, 3D image, etc. Alternatively,the mode selection unit 3151 may switch to the distance measurement modeto secure a distance value of the subject that is set to a desirablevalue or, alternatively, optimized for recognition of the identificationimage.

In the distance measurement mode, the mode selection unit 3151 transfersthe color image data CID or the infrared image data (mono image data)MID to the distance measurement module 3153. The distance measurementmodule 3153 may include the mono image correction unit 1156 and thedistance calculation unit 1157 of FIG. 3, and may calculate the distancevalue dd by using the infrared image data MID. Alternatively, thedistance measurement module 3153 may measure the distance value dd bymatching the color image data CID and the mono image data MID in theinfrared cut-off mode of FIG. 10. The distance measurement module 3153may measure the distance value dd to output distance data SDD. If thedistance value dd is within a reference range, the mode selection unit3151 may switch to the identification image detection mode.

In the normal image detection mode, the mode selection unit 3151transfers the color image data CID or the infrared image data (monoimage data) MID to the normal image obtaining module 3155. The normalimage obtaining module 3155 receives the color image data CID andoutputs normal image. In this case, the quality of image may be improvedbased on brightness information of the mono image data MID.

In the iris recognition mode, the mode selection unit 3151 transfers thecolor image data CID or the infrared image data (mono image data) MID tothe iris recognition module 3156 and may recognize the iris of the user.The iris recognition module 3156 performs a method of recognizing a partof the subject, according to at least some example embodiments of theinventive concepts. In the face recognition mode, the mode selectionunit 3151 transfers the color image data CID or the infrared image data(mono image data) MID to the face recognition module 3157 and mayrecognize the face of the user. The face recognition module 3157performs a method of recognizing a part of the subject, according to atleast some example embodiments of the inventive concepts. In the 3Dimage obtaining module, the mode selection unit 3151 transfers the colorimage data CID or the infrared image data (mono image data) MID to the3D image obtaining module 3158 and obtains a 3D image by using the monoimage sensor 1120 or 2120 and the color image sensor 1110 or 2110.

The compression unit 3519 compresses an image obtained by the imageobtaining module 3154 and provides the compressed image to theapplication processor 1200 or 2200. In detail, the compressed image maybe stored in the storage device 1400 or 2400 and may be displayed in thedisplay 1300 or 2300.

According to at least some example embodiments of the inventiveconcepts, as an illuminance value and a distance of a subject aremeasured without a separate sensor, an identification image may beexactly detected.

Example embodiments of the inventive concepts having thus beendescribed, it will be obvious that the same may be varied in many ways.Such variations are not to be regarded as a departure from the intendedspirit and scope of example embodiments of the inventive concepts, andall such modifications as would be obvious to one skilled in the art areintended to be included within the scope of the following claims.

What is claimed is:
 1. A smartphone comprising: an image detectingdevice comprising: a first infrared lighting unit configured to providefirst infrared rays to a subject; a second infrared lighting unitconfigured to provide second infrared rays to the subject; and a firstsensor configured to sense a first infrared light reflected from thesubject based on the first infrared rays, and an image signal processorconfigured to process a facial recognition based on the first infraredlight reflected from the subject and to process a distance measurementbetween the subject and the first sensor based on a second infraredlight reflected from the subject, wherein a distance between the secondinfrared lighting unit and the first sensor is shorter than a distancebetween the first infrared lighting unit and the first sensor.
 2. Thesmartphone of claim 1, further comprising a second sensor configured tosense visible light and to output color image data based on the sensedvisible light.
 3. The smartphone of claim 2, further comprising anapplication processor configured to control the first sensor and thesecond sensor, and wherein the application processor is separated fromthe first sensor and the second sensor.
 4. The smartphone of claim 1,wherein the first infrared light unit comprise a first infrared lightingunit driver and a first infrared lighting unit source, and wherein thefirst infrared lighting unit driver is configured to control driving ofthe first infrared lighting unit source.
 5. The smartphone of claim 1,wherein the second infrared light unit comprise a second infraredlighting unit driver and a second infrared lighting unit source, andwherein the second infrared lighting unit driver is configured tocontrol driving of the second infrared lighting unit source.
 6. Thesmartphone of claim 1, wherein the first infrared lighting unit isconfigured to provide the first infrared rays with a first level ofpower and the second infrared lighting unit is configured to provide thesecond infrared rays with a second level of power lower than the firstlevel of power.
 7. The smartphone of claim 1, further comprising atiming controller configured to control an operation of the first sensorand to drive the first infrared lighting unit.
 8. The smartphone ofclaim 7, wherein the timing controller is configured to synchronize asense time of the first sensor with a time during which the firstinfrared lighting unit provides the first infrared rays.
 9. Thesmartphone of claim 7, wherein the timing controller is configured todrive both the first infrared lighting unit and the second infraredlighting unit.
 10. A smartphone comprising: an image detecting devicecomprising: a first infrared lighting unit configured to provide firstinfrared rays to a subject; a second infrared lighting unit configuredto provide second infrared rays to the subject; and a first sensorconfigured to sense a first infrared light reflected from the subjectbased on the first infrared rays, and an image signal processorconfigured to process a three-dimensional recognition of the subjectbased on the first infrared light reflected from the subject and toprocess a distance measurement between the subject and the first sensorbased on a second infrared light reflected from the subject, wherein adistance between the second infrared lighting unit and the first sensoris shorter than a distance between the first infrared lighting unit andthe first sensor.
 11. The smartphone of claim 10, further comprising asecond sensor configured to sense visible light and to output colorimage data based on the sensed visible light.
 12. The smartphone ofclaim 11, further comprising an application processor configured tocontrol the first sensor and the second sensor, and wherein theapplication processor is separated from the first sensor and the secondsensor.
 13. The smartphone of claim 10, wherein the first infrared lightunit comprise a first infrared lighting unit driver and a first infraredlighting unit source, and wherein the first infrared lighting unitdriver is configured to control driving of the first infrared lightingunit source.
 14. The smartphone of claim 10, wherein the second infraredlight unit comprise a second infrared lighting unit drive and a secondinfrared lighting unit source, and wherein the second infrared lightingunit drive is configured to control driving of the second infraredlighting unit source.
 15. The smartphone of claim 10, wherein the firstinfrared lighting unit is configured to provide the first infrared rayswith a first level of power and the second infrared lighting unit isconfigured to provide the second infrared rays with a second level ofpower lower than the first level of power.
 16. The smartphone of claim10, further comprising a timing controller configured to control anoperation of the first sensor and to drive the first infrared lightingunit.
 17. The smartphone of claim 16, wherein the timing controller isconfigured to synchronize a sense time of the first sensor with a timeduring which the first infrared lighting unit provides the firstinfrared rays.
 18. The smartphone of claim 16, wherein the timingcontroller is configured to drive both the first infrared lighting unitand the second infrared lighting unit.